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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed 1-16-07 have been fully considered but they are not 
persuasive. 

2. Applicant argues that Johnson does not teach ' . . .an audible utterance to a third party or 
hear an audible response from the third party. . . 9 in claim 1 . Examiner agrees. That is why claim 
1 is rejected under 103(a) in view of Rosenthal. Rosenthal clearly discloses this claimed 
limitation. However, Applicant argues that Rosenthal does not disclose simultaneous 
communication over both channels. Examiner disagrees. Rosenthal clearly discloses 
simultaneous communication with first party and a called subscriber and an incoming caller or 
second party that calls the called subscriber, wherein the called subscriber has an active 
communication channel available to both parties. Although the first party is on hold with the 
called subscriber when an announcement is sent to second party, the first party is still in active 
communication with the called subscriber. The limitations broadly recite 'simultaneous 
communication' and the Examiner considers the 'simultaneous communication' as an active 
connection between the called subscriber and the other two parties (col. 8, lines 4-13; col. 8, line 
29 -col. 12, line 29). This argument is applied to all the claims rejected under Johnson in view 
of Rosenthal. 

3. The remarks in the arguments 6 . . .hear an audible response from the third party. . . ' are not 
recited in the claims. 

4. The prior art clearly discloses the claimed invention. 
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Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 1-8 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. Patent 
No. 6,366,578 by Johnson in view of U.S. Patent No. 5,764,748 by Rosenthal et al, hereinafter 
Rosenthal. 

Regarding claim 1, Johnson discloses a method for a user or office attendant-type 
program user to communicate over multiple channels (see Fig. 8 A: Lines 1-5), comprising the 
steps of: 

(a) communicating over a first channel (wherein the office attendant-type program receives an 
incoming call for a particular user, Mike; Fig. 9B) (col. 25, lines 53-62); 

(b) initiating a new communication (e.g. an office attendant-type program user sending a Net 
Message to called party Mike; Fig. 10A; col. 28, lines 18-57), by performing the following steps: 

(1) selecting a second channel (sending a Net Message to Mike; Fig. 10A); 

(2) selecting a phrase which can be predefined, recorded as needed, or synthetically generated on 
demand (e.g. typing a desired message) (col. 28, lines 18-57); 

(3) generating a net message representative of the selected phrase; and 

(4) providing the net message over the selected second channel only while communicating over 
the first channel simultaneously (col. 26, lines 27-39; see Fig. 10B; col. 28, line 59 - col. 29, line 
7). 
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Johnson discloses communicating over multiple channels. However, Johnson does not 
disclose generating and providing an audible utterance. 

Rosenthal discloses a method for a user to communicate over multiple channels (see 
Abstract; see Fig. 1), comprising steps of: 

(a) communicating over a first channel (e.g. first call); and 

(b) initiating a new communication (e.g. responding to an incoming second call signal (e.g. call 
waiting)) (col. 1, lines 16-24; col. 2, lines 6-15 and lines 30-44; col. 5, line 57 - col. 6, line 8; 
col. 6, line 18 - col. 8, line 3), by performing the following steps: 

(1) selecting a second channel (e.g. a second call) (e.g. send a speech signal to a second caller); 

(2) selecting a phrase which can be predefined, recorded as needed, or synthetically generated on 
demand (e.g. Call me later or Call me back in forty five minutes are predefined announcements) 
(col. 8, line 29 -col. 12, line 29); 

(3) generating an audible utterance representative of the selected phrase; and 

(4) providing the audible utterance over the selected second channel only while communicating 
over the first channel simultaneously (col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the method of Johnson to include generating and providing an audible 
utterance as taught by Rosenthal. One of ordinary skill in the art would have been lead to make 
such a modification to transform a user's silent input selections into equivalent audible signals 
that may be directly transmitted to a recipient on a second communication channel while 
communicating over a first channel simultaneously. 
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Regarding claim 2, the method of claim 1, wherein Rosenthal further discloses the step of 
providing the audible utterance over the selected channel (col. 8, lines 4-13; col. 8, line 29 -col. 
12, line 29). 

Rosenthal does not disclose selecting a second channel further includes selecting a 
plurality of channels. 

Johnson further discloses a selecting a second channel further includes selecting a 
plurality of channels, wherein the office attendant-type program user sets up a conference call 
with various users (Figs. 8A-8D; Fig. 1 1A-1 IE; col. 30, line 1 - col. 31, line 26). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the method of Rosenthal to include selecting a second channel further 
includes selecting a plurality of channels as taught by Johnson. One of ordinary skill in the art 
would have been lead to make such a modification since more than one recipient on a plurality of 
channels can receive a message from the user. 

Regarding claim 3, the method of claim 1, wherein Rosenthal further discloses the step of 
generating an audible utterance includes the step of obtaining an internal representation of a 
phrase element associated with the selected phrase and generating an audible utterance based on 
an internal phrase element (col. 4, lines 54-64; col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 

Regarding claim 4, the method of claim 1, wherein Johnson further discloses the step of 
selecting a second channel includes selecting a graphical representation of said second channel 
using a graphical user interface (Fig. 9A and Fig. 9B). 
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Regarding claim 5, the method of claim 1, wherein Johnson further discloses the step of 
selecting a phrase includes selecting a graphical representation of said phrase using a graphical 
user interface (Fig. 10A; col. 28, lines 18-57). 

Regarding claim 6, the method of claim 5, wherein Johnson further discloses the 
graphical representation of said phrase is selected from a group consisting of an icon, a symbol, a 
figure, a graph, a checkbox, a GUI widget, a graphics button, and a pulldown menu button (Fig. 
10A; col. 28, lines 18-57). 

Regarding claim 7, the method of claim 1, wherein Johnson further discloses said internal 
representation of said selected phrase is obtained from a host computer (wherein the office 
attendant-type program is located on a host computer) (col. 19, lines 26-30; Fig. 8 A and Fig. 
10A; col. 28, lines 18-57). 

Regarding claim 8, the method of claim 1, wherein Rosenthal further discloses the step 
generating an audible utterance includes text-to-speech processing (col. 4, lines 54-64; col. 8, 
lines 4-13; col. 8, line 29 ^col. 12, line 29). 

7. Claims 9, 11,12, and 14-18 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Johnson in view of Rosenthal. 

Regarding claim 9, Johnson discloses a multi-channel telecommunication system (see 
Fig. 8 A: Lines 1-5; Fig. 9A), comprising: 

(a) an audio input or telephone (col. 17, line 48 - col. 18, line 36); 

(b) a channel representation (Fig. 9A and Fig. 9B); 

(c) a phrase representation which can be predefined, recorded as needed, or synthetically 
generated on demand (e.g. typing a desired message) (Fig. 10A; col. 28, lines 18-57); 
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(d) a display capable of displaying a channel representation and a phrase representation (Fig. 8A; 
Fig. 9 A, Fig 10A); 

(e) a memory or computer (Fig. 2, 24) capable of storing the channel representation, phrase 
representation, and phrase element associated with the phrase representation, wherein the phrase 
element has an internal representation of a text message (col. 17, line 48 - col. 18, line 36); 

(f) a processor or office attendant-type program, coupled to the audio input, display, and 
memory, wherein the processor initiates a first control signal and a second control signal not in 
response to an incoming communication (e.g. an office attendant-type program user sending a 
Net Message to called party Mike; Fig. 10A; col. 25, lines 53-62; col. 28, lines 18-57); 

(g) a text generator (utilizing Net Messaging), coupled to the processor and memory, wherein the 
text generator generates a text responsive to the first control signal and the phrase element (col. 
22, lines 38-44); and, 

(h) a channel selector, coupled to the processor and text generator, wherein the channel selector 
selects a channel responsive to the second control signal and provides the text message over the 
selected channel only while communicating over another channel simultaneously (col. 26, lines 
16-26). 

Johnson discloses a multi-channel telecommunication system with channel and phrase 
representation. However, Johnson does not disclose the phrase element has an internal 
representation of an audible utterance and an audio generator. 

Rosenthal discloses a multi-channel telecommunication system (Fig. 1), comprising: 
/ (a) an audio input or telephone (Fig. 1 : 1 1 , 2 1 ); 

(b) a channel representation (e.g. alert for an incoming second caller); 
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(c) a phrase representation which can be predefined, recorded as needed, or synthetically 
generated on demand (e.g. e.g. Call me later or Call me back in forty five minutes are predefined 
announcements) (col. 8, line 29 -col. 12, line 29); 

(d) a display capable of displaying a channel representation and a phrase representation (Fig. 1, 
11; col. 2, lines 6-12); 

(e) a memory or switch (Fig. 1, 100) capable of storing the channel representation, phrase 
representation, and phrase element associated with the phrase representation, wherein the phrase 
element has an internal representation of an audible utterance (e.g. Call me later or Call me back 
in forty five minutes are predefined announcements) (col. 4, lines 24-64; col. 8, line 29 -col. 12, 
line 29); 

(f) a processor (e.g. button presses), coupled to the audio input, display, and memory, wherein 
the processor initiates a first control signal and a second control signal not necessarily in 
response to an incoming communication (e.g. responding to an incoming second call signal (e.g. 
call waiting)) (col. 1,, lines 16-24; col. 2, lines 6-15 and lines 30-44; col. 5, line 57 - col. 6, line 
8; col. 6, line 18 - col. 8, line 3; col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29); 

(g) an audio generator (Fig. 1,117), coupled to the processor and memory, wherein the audio 
generator generates an audible utterance responsive to the first control signal and the phrase 
element (col. 4, lines 54-64; col. 5, line 57 - col. 6, line 8); and, 

(h) a channel selector, coupled to the processor and audio generator, wherein the channel selector 
selects a channel responsive to the second control signal and provides the audible utterance over 
the selected channel only while communicating over another channel simultaneously (col. 3, line 
66 - col. 4, line 9; col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 
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It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the system of Johnson to include an audio generator and provide an audible 
utterance over the selected channel as taught by Rosenthal. One of ordinary skill in the art would 
have been lead to make such a modification since an audio generator generates an audible 
utterance associated with a phrase representation that may be directly transmitted to a recipient 
on a selected communication channel while communicating over another channel 
simultaneously. 

Regarding claim 1 1, the multi-channel telecommunication system of claim 9, wherein 
Rosenthal further discloses the multi-channel telecommunication system further comprises: 
(i) an audio mixer, coupled to the processor and channel selector, mixing audio received from 
said channel selector (col. 10, line 57 - col. 11, line 9). 

Regarding claim 12, the multi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the phrase representation and channel representation are displayed in a 
graphic user interface (GUI) (Fig. 9A and Fig. 10A). 

Regarding claim 14, the multi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the channel representation is selected from a group consisting of a text 
and a label (Fig. 10A; col. 28, lines 18-57). 

Regarding claim 15, the multi-channel telecommunication system of claim 9, wherein 
Rosenthal further discloses the internal representation is in a format selected from a group 
consisting of a sound file, a record or playback, a text, and a Musical Instrument Digital Interface 
("MIDI") sequence (col. 4, lines 54-64; col. 9, line 24 - col. 1 1 , line 29). 
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Regarding claim 16, the multi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the internal representation is obtained from a host computer (Fig. 2, 50) 
(col. 28, lines 18-57). 

Regarding claim 1 7, the multi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the first control signal is inherently generated in response to a user 
selecting the phrase representation and the second control signal is inherently generated in 
response to a user selecting the channel representation (col. 28, lines 1 8-57). 

Regarding claim 18, the multi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the phrase representation and channel representation are selected from 
a group consisting of a button, a switch, a barcode, a label, a glyph, and Braille (Fig. 9A and Fig. 
10A; col. 28, lines 18-57). 

8. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in view 
of Rosenthal, as applied to claim 9 above, and in further view of U.S. Patent No. 5,894,504 by 
Alfred et al, hereinafter Alfred. 

Regarding claim 13, the multi-channel telecommunication system of claim 9, wherein 
Johnson in view of Rosenthal do not disclose the multi-channel telecommunication system 
further comprises: (h) an audio monitor, coupled to the processor of channel selector, monitoring 
an audio level received from said channel selector. 

Alfred discloses a method for a user or called party to communicate with a plurality 
of recipients over a plurality of channels (see Abstract; Fig. 3), comprising steps of: (a) 
communicating over a first channel with a first recipient (first caller) (Fig. 3, 301); (b) receiving 
an indication over a second channel of a second recipient (via Call Waiting) (Fig. 3, 305; col. 3, 
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line 36 - col. 4, line 9; col. 5, line 50 - col. 6 5 line 18); (c) selecting to receive advanced 
messaging service by dialing *33 (Fig. 3, 307); (d) the second call-in-waiting caller records a 
message (Fig. 3: 308, 309); and (e) audio input from said first and second channel are mixed and 
can be heard by the user (col. 7, lines 15-37). Wherein an audio monitor or communications 
switch (Fig. 1, 105), coupled to a processor or message processing system (Fig. 1, 109) and 
channel selector or voice messaging system (Fig. 1,112), monitoring an audio level received 
from said channel selector (col. 4, lines 10-65; col. 7, lines 15-37). 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the method of Johnson in view of Rosenthal to include an audio monitor as 
taught by Alfred. One of ordinary skill in the art would have been lead to make such a 
modification gince mixed audio input can allow the user to hear the audio input from the 
channels simultaneously and the user can hear both conversations of the channels at different 
audio levels. 

9. Claims 19-22 rejected under 35 U.S.C. 103(a) as being obvious over U.S. Patent No. 
6,941,342 by Nelson in view of Johnson. 

The applied reference has a common assignee and at least one common inventor with the 
instant application. Based upon the earlier effective U.S. filing date of the reference, it 
constitutes prior art only under 35 U.S.C. 102(e). This rejection under 35 U.S.C. 103(a) might 
be overcome by: (1) a showing under 37 CFR 1 .132 that any invention disclosed but not claimed 
in the reference was derived from the inventor of this application and is thus not an invention "by 
another"; (2) a showing of a date of invention for the claimed subject matter of the application 
which corresponds to subject matter disclosed but not claimed in the reference, prior to the 
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effective U.S. filing date of the reference under 37 CFR 1.131; or (3) an oath or declaration 
under 37 CFR 1.130 stating that the application and reference are currently owned by the same 
party and that the inventor named in the application is the prior inventor under 35 U.S.C. 104, 
together with a terminal disclaimer in accordance with 37 CFR 1.321(c). This rejection might 
also be overcome by showing that the reference is disqualified under 35 U.S.C. 103(c) as prior 
art in a rejection under 35 U.S.C. 103(a). See MPEP § 706.02(1)(1) and § 706.02(1)(2). 
Regarding claim 19, Nelson discloses a system (see Abstract), comprising: 

(a) a plurality of input channels (col. 6, lines 40-57); 

(b) a processing device (e.g. controller) for storing an internal representation of a phrase element 
which can be predefined, recorded as needed, or synthetically generated on demand (e.g. 
predefined conversation representation; 'Hello'); and, 

(c) a scanning device, coupled with the processing device, for reading a first code associated 
with the phrase element, wherein the processing device provides an audible utterance only over 
the channel in response to reading the first code while communicating over another channel 
simultaneously (e.g. while a user is in a meeting or in a conference call) (Figs. 10-12; col. 13, 
lines 20-62). 

Nelson does not disclose reading a second code associated with at least one of the 
plurality of input channels. 

Johnson discloses a system (Figs. 8A-8D), comprising: 
(a) a plurality of input channels (see Fig. 8A: Lines 1-5); 
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(b) a processing device (Figs. 8A-8D) for storing an internal representation of a phrase element 
which can be predefined, recorded as needed, or synthetically generated on demand (e.g. typing a 
desired message) (col. 28, lines 18-57); and, 

(c) reading a first code associated with the phrase element (an office attendant-type program user 
typing a Net Message to called party Mike; Fig. 10A; col. 28, lines 18-57) and for reading a 
second code associated with at least one of the plurality of input channels (sending a Net 
Message to Mike; Fig. 10A), wherein processing device initiates to provide a net message only 
over the channel associated with said second code while communicating over another channel 
simultaneously (col. 26, lines 27-39; see Fig. 10B; col. 28, line 59 - col. 29, line 7). 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the system of Nelson to include a second code as taught by Johnson. One of 
ordinary skill in the art would have been lead to make such a modification to transform a user's 
silent input selections into equivalent audible signals that may be directly transmitted to a 
recipient on a second communication channel associated with a second code while 
communicating over another channel simultaneously. 

Regarding claim 20, the system of claim 19, wherein Johnson further discloses the 
processing device includes: a channel selection device (Figs. 8A-8D), for selecting at least one of 
the plurality of input channels responsive to said second code (Fig. 1 1 A-l IE; col. 30, line 1 - 
col. 31, line 26). 

Regarding claim 21, the system of claim 19, wherein Nelson further discloses the 
scanning device is a barcode scanner (Fig. 11,113). 
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Regarding claim 22, the system of claim 19, wherein Nelson further discloses the 
scanning device is a laser scanner (Fig. 10, 104). 

10. Claims 23-26 are rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in 
view of Rosenthal. 

Regarding claim 23, Johnson discloses a general purpose computing device (Fig. 2, 24), 
comprising: 

(a) a display, capable of displaying a channel representation and a phrase representation (Fig. 
8A,Fig.9A,Fig. 10A); 

(b) a memory or computer (Fig. 2, 24), capable of storing the channel representation, phrase 
representation, and a phrase element associated with the phrase representation, wherein the 
phrase element can be predefined, recorded as needed, or synthetically generated on demand 
(e.g. typing a desired message) (col. 28, lines 18-57) and has an internal representation of a text 
message (col. 17, line 48 - col. 18, line 36); 

(c) a processor or office attendant-type program, coupled to the display and memory, wherein the 
processor initiates to generate a first control signal responsive to selection of the channel 
representation and a second control signal responsive to selection of the phrase representation 
(e.g. an office attendant-type program user sending a pre-generated Net Message to a called party 
Mike; Fig. 10A; col. 28, lines 18-57); 

(d) a text generator, coupled to the processor and memory, wherein the text generator generates a 
text responsive to the second control signal and the phrase element (col. 22 , lines 38-44); and 

(e) a channel selector, coupled to the processor and text generator, wherein the channel selector 
activates a channel responsive to the first control signal and provides the text message over the 
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selected channel only not in response to an incoming communication while communicating over 
another channel simultaneously (col. 26, lines 16-26). 

Johnson discloses a general purpose computing device displaying channel and phrase 
representation. However, Johnson does not disclose the phrase element has an internal 
representation of an audible utterance and an audio generator. 

Rosenthal discloses a device (Fig. 1, 11), comprising: 

(a) a display, capable of displaying a channel representation (e.g. alert for an incoming second 
caller) and a phrase representation (e.g. Call me later or Call me back in forty five minutes are 
predefined announcements) (col. 8, line 29 -col. 12, line 29); 

(b) a memory or switch (Fig. 1, 100), capable of storing the channel representation, phrase 
representation, and a phrase element associated with the phrase representation, wherein the 
phrase element can be predefined, recorded as needed, or synthetically generated on demand 
(e.g. Call me later or Call me back in forty five minutes are predefined announcements) (col. 8, 
line 29 -col. 12, line 29) and has an internal representation of an audible utterance (col. 4, lines 
24-64); 

(c) a processor (e.g. button presses), coupled to the display and memory, wherein the processor , 
initiates to generate a first control signal responsive to selection of the channel representation and 
responsive to selection of the phrase representation (col. 8, lines 4-13; col. 8, line 29 -col. 12, 
line 29); 

(d) an audio generator (Fig. 1, 117), coupled to the processor and memory, wherein the audio 
generator generates an audible utterance responsive to the control signal and the phrase element 
(col. 4, lines 54-64); and 
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(e) a channel selector, coupled to the processor and audio generator, wherein the channel selector 
activates a channel responsive to the first control signal and provides the audible utterance over 
the selected channel only while communicating over another channel simultaneously (col. 3, line 
66 - col. 4, line 9). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the general purpose computing device of Johnson to include the phrase 
element has an internal representation of an audible utterance and an audio generator as taught 
by Rosenthal. One of ordinary skill in the art would have been lead to make such a modification 
to transform a user's silent input selections into equivalent audible signals that may be directly 
transmitted to a recipient on a selected communication channel while communicating over 
another channel simultaneously. 

Regarding claim 24, the general purpose computing device of claim 23, wherein Johnson 
further discloses the display is a touchscreen display (Fig. 8A; col. 23, line 43 - col. 24, line 65). 

Regarding claim 25, the general purpose computing device of claim 23, wherein Johnson 
further discloses the channel representation and phrase representation are displayed in a 
Graphical User Interface (GUI) (Fig. 9A and Fig. 10A). 

Regarding claim 26, the general purpose computing device of claim 23, wherein Johnson 
further discloses the general purpose computing device is a personal digital assistant, wherein the 
office attendant-type program may be run remotely (col. 32, lines 8-39). 
1 1 . Claims 27-34 are rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in 
view of Rosenthal. 
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Regarding claim 27, Johnson discloses a telecommunication infrastructure (see Fig. 2 and 
Abstract), comprising: 

(a) a first electronic device coupled to the telecommunication infrastructure over a first channel 
(Fig. 2, 24); 

(b) a second electronic device coupled to the telecommunication infrastructure over a second 
channel (Fig. 2, 24); 

(c) a third electronic device coupled to the telecommunication infrastructure (Fig. 2, 24; col. 17, 
line 48 - col. 18, line 36), selecting the first channel or the second channel and selecting a phrase 
representation which can be predefined, recorded as needed, or synthetically generated on 
demand (e.g. an office attendant-type program user sending a Net Message to called party Mike; 
typing a desired message; Fig. 10A; col. 28, lines 18-57); and 

(d) a processing device (communications system; Fig. 2, 50; col. 7, lines 16-47) coupled to the 
telecommunication infrastructure, capable of storing: 

1) a phrase element associated with the phrase representation (col. 28, lines 18-57); and, 

2) a software program for providing a Net Message over the selected first or second channel only 
in response to a selected phrase representation while permitting the third electronic device to 
communicate simultaneously over the unselected second or first channel (col. 26, lines 27-39; 
see Fig. 10B; col. 28, line 59 - col. 29, line 7). 

Johnson discloses a telecommunication infrastructure comprising three electronic 
devices. However, Johnson does not disclose providing an audible utterance in response to a 
selected phrase representation. 



> 
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Rosenthal discloses a telecommunication infrastructure (see Fig. 1 and Abstract), 
comprising: 

(a) a first electronic device coupled to the telecommunication infrastructure over a first channel 
(Fig. 1,21); 

(b) a second electronic device coupled to the telecommunication infrastructure over a second 
channel (Fig. 1, 201); 

(c) a third electronic device, coupled to the telecommunication infrastructure (Fig. 1,11), 
selecting the first channel or the second channel and selecting a phrase representation which can 
be predefined, recorded as needed, or synthetically generated on demand (e.g. Call me later or 
Call me back in forty five minutes are predefined announcements) (col. 8, line 29 -col. 12, line 
29); and, 

(d) a processing device (Fig. 1, 100), coupled to the telecommunication infrastructure, capable of 
storing: 

1) a phrase element associated with the phrase representation; and, 

2) a software program for providing an audible utterance over the selected first or second 
channel only in response to a selected phrase representation while permitting the third electronic 
device to hold the communication simultaneously over the unselected second or first channel 
(col. 4, lines 24-64; col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the telecommunications infrastructure of Johnson to include providing an 
audible utterance in response to a selected phrase representation as taught by Rosenthal. One of 
ordinary skill in the art would have been lead to make such a modification to allow a third 
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electronic device to transform a user's silent input selections into equivalent audible signals that 
may be directly transmitted to a recipient on a second communication channel while 
communicating over a first channel simultaneously. 

Regarding claim 28, the telecommunication infrastructure of claim 27, wherein Rosenthal 
further discloses the third electronic device generates an in-band signal in response to a phrase 
representation selection and a channel representation selection (col. 8, line 29 -col. 12, line 29). 

Regarding claim 29, wherein Johnson further discloses the third electronic device 
generates an out-of-band signal in response to a phrase representation selection and a channel 
representation selection (Fig. 9A and Fig. 10A). 

Regarding claim 30, the telecommunications infrastructure of claim 28, wherein 
Rosenthal further discloses the signal is a Dual-Tone Multi Frequency ("DTMF") signal (*1) 
(col. 8, line 29 -col 12, line 29). 

Regarding claim 3 1 , wherein Johnson further discloses the phrase representation is 
selected from a group consisting of an icon, a symbol, a figure, a graph, a checkbox, a GUI 
widget and a graphics button (Fig. 10A; col. 28, line 59 - col. 29, line 7). 

Regarding claim 32, the telecommunications infrastructure of claim 27, wherein 
Rosenthal further discloses the phrase representation is selected from a group consisting of a text 
and a label (col. 4, lines 54-64; col. 8, line 29 -<ol 12, line 29). 

Regarding claim 33, wherein Johnson further discloses the processing device is a 
computer coupled to the Internet (Fig. 2, 50; col. 8, lines 27-45). 
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Regarding claim 34, the telecommunication infrastructure of claim 27, wherein Rosenthal 
further discloses the processing device is a relay between the first electronic device, the second 
electronic device, and the third electronic device (Fig. 1, 100; col. 4, lines 24-64). 
12. Claims 35-41 are rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in 
view of Rosenthal. 

Regarding claim 35, Johnson discloses a method for a user to communicate with a 
plurality of recipients over a plurality of channels (see Fig. 8A: Lines 1-5), comprising steps of: 

(a) communicating over a first channel (wherein the office attendant-type program receives an 
incoming call for a particular user, Mike; Fig. 9B) with a first recipient (e.g. caller); 

(b) selecting a second channel for generating a net message (sending a Net Message to Mike; 
Fig. 10A); 

(c) selecting a phrase representation which can be predefined, recorded as needed, or 
synthetically generated on demand (e.g. an office attendant-type program user sending a Net 
Message to called party Mike; typing a desired message; Fig. 10A; col. 28, lines 18-57) and; 

(d) generating a net message only over said selected channel based on said selected phrase 
representation while communicating over the first channel simultaneously (col. 26, lines 27-39; 
see Fig. 10B; col. 28, line 59 - col. 29, line 7). 

Johnson discloses communicating with a plurality of recipients over a plurality of 
channels. However, Johnson does not disclose generating an audible utterance. 

Rosenthal discloses a method for a user to communicate with a plurality of recipients 
over a plurality of channels (see Abstract), comprising steps of: 
(a) communicating over a first channel with a first recipient (e.g. first call); 
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(b) selecting a channel for generating an audible utterance (e.g. send a speech signal to a second 
caller); 

(c) selecting a phrase representation which can be predefined, recorded as needed, or 
synthetically generated on demand (e.g. Call me later or Call me back in forty five minutes); and 

(d) generating an audible utterance only over said selected channel while communicating over 
the first channel simultaneously (col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the method of Johnson to include generating an audible utterance as taught 
by Rosenthal. One of ordinary skill in the art would have been lead to make such a modification 
to transform a user's silent input selections into equivalent audible signals that may be directly 
transmitted to a recipient on a second communication channel while communicating over a first 
channel simultaneously. 

Regarding claim 36, the method of claim 35, wherein Rosenthal further discloses audio 
input from said plurality of channel are mixed (col. 10, line 57 - col. 11, line 34). 

Regarding claim 37, the method of claim 35, wherein Rosenthal further discloses 
including the step of: obtaining an internal representation of a phrase element (e.g. text) 
associated with said selected phrase representation (e.g. Call me later or Call me back in forty 
five minutes) (col. 4, lines 54-64). 

Regarding claim 38, the method of claim 35, wherein Rosenthal further discloses said 
step of selecting a channel for generating an audible utterance includes the steps of: accessing a 
channel representation; and, selecting a channel representation (e.g. by dialing the code *1 to 
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select the second caller or calling subscriber to receive an audible utterance) (col. 8, line 36 - col. 
9, line 4; col. 9, line 13 - col. 10, line 56). 

Regarding claim 39, the method of claim 38, wherein Johnson further discloses said 
channel representation is displayed on a graphical user interface (Fig. 9A). 

Regarding claim 40, the method of claim 35, wherein Rosenthal further discloses 
said step of selecting a phrase for generating an audible utterance includes the steps of: accessing 
a phrase representation; and, selecting a phrase representation (col. 4, lines 54-64; col. 8, line 36 
- col. 9, line 4; col. 9, line 13 - col. 10, line 56). 

Regarding claim 41, wherein Johnson further discloses said phrase representation is 
displayed on a graphical user interface (Fig. 10A; col. 28, line 59 - col. 29, line 7). 

Conclusion 

13. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. See PTO-892 Form. 

14. Any response to this action should be mailed to: 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

Or faxed to: 

(571) 273-8300 (for formal communications intended for entry) 

Or call: 

(571) 272-2600 (for customer service assistance) 
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15. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Lisa Hashem whose telephone number is (571) 272-7542. The 
examiner can normally be reached on M-F 8:30-5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Fan Tsang can be reached on (571) 272-7547. Any inquiry of a general nature or 
relating to the status of this application or proceeding should be directed to the Group 
receptionist whose telephone number is (571) 272-2600. 

16. Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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